DOCUMENT RESUME 



ED 236 980 



HE 016 736 



AUTHOR 
TITLE 

PUB DATE 
NOTE 



PUB TYPE 



EDRS PRICE 
DESCRIPTORS 



IDENTIFIERS 



Pickens, William H. 

Performance Funding in Higher Education: Panacea or 

Peril? 

Dec 82 

17p.; Paper presented at a Conference on Survival in 
the 1980's: Quality, Mission and Financing Options 
(Tucson, AZ, December 1982). Best copy available. 
Reports - Descriptive (141) — Speeches/Conference 
Papers (150 ) 

MFOl/PCOl Plus Postage. 

*Budgeting; College Programs; *Educational 
Assessment ; Educational Finance ; Evaluation Criteria; 
♦Financial Support ; Higher Education ; Instructional 
Improvement ; *Out comes of Education ; Performance ; 
Resource Allocation; *Tax Allocation 
*Perf ormance Budgeting; *Tennessee 



ABSTRACT 

The use of performance funding, which provides 
institutions with income for educational results, was tested in 
Tisnnessee. Traditionally, the budget has been separated from 
performance evaluation, and state formulas have evolved from the need 
for funding to be objective, comparable, and predictable. The 
Performance Funding Project in Tennessee, which was started in 1974 
by the Tennessee Higher Education Commission, was designed to 
accomplish the following: to sharpen institutional mission, tc 
complement the enrollment-based formula, to objectively measure 
educational outcomes, to measure the educational "value added" by 
each institution, and to promote institutional excellence without 
competition. After establishing pilot projects and developing 
assessment measures, the Tennessee Commission established the 
performance concept within the state's budget formulas. To provide a 
profile for funding, an Instructional Evaluation Schedule was 
developed based on the following variables: program accreditation; 
program field evaluation, institution-wide education outcomes 
(general education outcomes, placements in vocational fields); 
instructional improvement based on referent group surveys ( student s , 
alumni, community leaders); and planning for instructional program 
improvement. (SW) 
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Traditionally, funding for instruction in higher education has 
relied on certain measures: student credit units, contact hours, 
faculty workload, or degrees conferred. Partly because of academic 
convention and partly because the alternatives seeded so subjective, 
funding formulas in higher education have usually been based on how 
much is done (credits and degrees) , not how well it is done (changes 
in knowledge, enhanced lives, career development). Nevertheless, 
the philosophical justification for performance funding is per- 
suasive in that institutions should receive some income for educa- 
tional results, not simply for activities. 

To say that state governments have avoided performance funding is 
not to suggest that they have been complacent about the quality of 
instruction. Several have established generous funds for instruc- 
tional improvement such as grants for innovative projects or rewards 
for incorporating new ideas into the regular curriculum. Many 
institutions have received support for special evaluations and for 
reforms recommended by accrediting associations. Indeed, the 1970s 
overflowed with activities to define and organize educational 
outcomes, the most ambitious being the Structure for the Outcomes 
of Postsecondary Education published by th^ National Center for 
Higher Education Management Systems (NCHEMS) . 

Given this emphasis on outcomes, why has the tradition of separat- 
ing the budget from performance evaluation had such potency? Most 
often, state formulas evol^ <sd from the need for funding to be 
objective, comparable, and predictable— characteristics ill-suited 
to the vagueries of instructional performance. Beyond that, poor 
educational results sho-ild not necessarily provoke fiscal punish- 
ment; an inferior program in some instances needs additional, funds 
to strengthen its efforts. 
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In addition, the practical problems of performance funding are 
imposing. People disagree on standards of evaluation- Since 
effectiveness requires objectives against which performance is 
measured, t^e objectives must relate to institutional missions and 
to their clientele. Further, narrow definitions of performance may 
result in standardized measures which deaden the enterprise and 
lead to "teaching for the test," Finally, objective performance 
measures undoubtedly discount the numerous activities in higher 
education which,^ though not quantifiable, significantly enhance the 
quality of life. Performance funding is a difficult business. 

So, nost states have separated funding and quality assessment. 
Typically, states have provided funds while the institutions them- 
selves, through administrative rigor and faculty review, have been 
primarily responsible for maintaining performance. Vflien this 
arrangement has broken down, state officials have usually vented 
their frustration by cutting budgets, rearranging governance, or 
funding new institutions--not by providing incentives in the formu- 
las themselves. 

Despite these traditions, the idea of performance funding \as 
remained hauntingly attractive, especially to educators sens tive 
to the political demand for accountability. The following p»ges 
describe an experiment conducted in Tennessee— perhaps the ftiost 
significant one in the nation—to test the feasibility of allocating 
some portion of state funds on a "performance" or "outcomes" tasis. 
We can learn something from this experiment. 



Performance Funding in Tennessee 

Beginning ia 1974, the Tennessee Higher Education Commission 
launched a $500,000 pilot effort, supported entirely by non-state 
funds, called the Performance Funding Project. The project started 
with two assumptions: 

o funding and educational performance should be linked; and 

o successful performance ^should not be judged solely by growth in 
the number of students. 

Although these assumptions are shared widely among educators around 
the nation, the technical difficulties of implementing a formula 
system based on performance measures had consigned them to the 
realm of impractical idealism. 
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Phase One: The Pilot Projects 



The staff of the Tennessee Conmission separated their planning into 
two phases. The first phasti consisted of establishing the pilot 
projects and developing assessment measures which might serve later 
within the general funding formula. Initial discussions were 
intentionally wide ranging, favoring expansive ideas rather than 
closure. According to the Coimnissioa staff, there were those who 
expected that the effort might yield a major alternative to enroll- 
ment-driven fundiiig. Others may have expected the project to 
provide justification for more money to higher education or a means 
to soften the potential loss of funding support if enrollments were 
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Gradually, the parties narrowed their discussions to measures that 
would complement, not replace, allocation based on enrollments. 
Since political support was essential if the performance measures 
were ever to be converted into dollars for the institutions, they 
had to be understanc able and acceptable to state officials. On the 
one hand, legislators were particularly concerned that institutions 
not be in competition with each other. They favored a "value-added 
criterion where performance would be evaluated in relation to the 
institution's own mission and its particular clientele. 

On the other hand, the institutions were concerned that their 
autonomy be protected even as their accountability was, to some 
degree, increased. They feared that the data could be misinter- 
preted by state officials, and that funds could be diverted from 
important purposes toward charades of high-powered evaluation. One 
widespread opinion was that the campuses were not receiving suffi- 
cient funds under tht -urrent formulas, and that enhancing these 
allocations should have first priority. The staff of the Tennessee 
Conmission was particularly skilled in balancing the conflicting 
interests. 

In 1975, nineteen of Tennessee's twenty-one public institutions 
submitted proposals for the pilot projects. After evaluation, only 
eleven were selected to participate in the two-year "experiment. 
During the first year, the institutions developed the performance 
measures; during the second, they compiled data on those measures. 
In developing their measures, the institutions were to pay special 
attention to the following questions: 

0 What was the institution's mission? (the need to sharpen defini- 
tions) 

o What indicators best measured performance toward this mission? 
(the need for measures congruent to the institution's mission) 




0 Could these indicators: 

--be objective and measurable? (the aeed for uuifurmity) 
—be comparable to similar institutions? (the need for equity) 
—permit longitudinal analysis? (the need to measure change over 
time) 

So the responsibilities would be clear, the Comdission negotiated a 
contract with the institutions 'in order to implement the pilots . 

The CoBBiission also circulated documents to focus the debate. Four 
authors collaborated on The Competent College Student , a controver- 
sial statement describing achievements expected of all degree 
candidates. The ensuing criticism prompted two campuses to draft 
their own statements on degree competencies, and they received a 
grant from the Commission for these efforts. Further, the Cormis- 
sion appointed a National Advisory Panel and a State Panel to guide 
planning, test ideas, and evaluate progress. The National Panel 
advised that two professionals outside Tennessee and prominent in 
higher education. Professors Fred Harcleroad and Cameron Fincher, 
be appointed as permanent evaluators. Th-2 framework for all activi- 
ty was leadership from E. Grady Bogue, Associate Director of the 
Tennessee Commission and director of the performance project. 
Bogue *s counterparts on the campuses were full-time project direc- 
tors, la total, thousands of hours were invested at all levels. 

In 1977, ench pilo^ campus reported its performance measures. 
Perhaps mc^:^ striking was the variety of approaches: some developed 
institutional tests for students, some relied on national examina- 
tions, some worked with accrediting organizations, some emphasized 
questionnaires. The report by the Tennessee Technological Univer- 
sity typifies the range of efforts: 

Tennessee Technological University [enrolls] approximately 
6,500 FTE students [and has] a range of undergraduate and 
graduate programs, but with historic emphasis on science 
and engineering (including a doctoral program in engineer- 
ing) . Extensive faculty involvement was established through 
a program of "faculty associates,** and 90% of the faculty 
participated in the goals identification exercise. Three 
categories of data — extra -institutional standardized tests, 
student and alumni surveys, and institutional activity 
data — were used to essess the performance of a represen- 
tative sample of seniors on general education goals of 
communication, knowledge of history and social/behavioral 
science, understandings of science and technology, problem 
solving skills and preparation for further study. ... 
Student performance was above national and state referent 
groups on the ACT College Outcomes Measures Project battery. 
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Change scores for students on the ACT examination were also 
significant. Locally developed student and alunnii surveys 
and other institutional data confirmed positive growth on 
goals. The university also has an ongoing evaluation of 
its teacher education program which was linked to this 
effort. 

Ratiier than establishing a single performance measure, the value of 
the pilots was their te^'t of a process. Specifically, Uiey tested: 

a. the willingness o^ campus personnel to involve themselves in 
performance assessment; 

b. the ability of a caApus to express its own educational unique- 



ness 



c. the ability of campus leaders to involve faculty and to elevate 
concern for performance assessment; 

d. the benefits of performance data to the faculty; and 

e. the potential for developing a partnership between the State 
and the institutions. 

Although the Tennessee Commission concluded that "not all projects 
achieved to- the level desired"^ nor was the process wholly success- 
ful, the second phase was initiated in 1978. 

Phase Two: Funding the Instructional Evaluation Schedule 

This phase implemented the performance concept for all institutions 
by establishing it within the state's budget formulas. After the 
pilots, the Commission staff developed an Instructional Evaluation 
Schedule which, when completed by the institutions, provided ^ 
profile for funding. The Schedule contained five variables which, 
theoretically, permitted the evaluation to be sensitive to the 
diverse characteristics of the institutions. 
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After each institution's total points were calculated by the Commis- 
sion staff or by an external evaluation team, these points were 
divided by 100 to establish the institution's percentage "rating." 
This rating was then multiplied by a dollar amount equal to 2 
percent of the institution's projected Educational and General 
Budget, which was the highest possible amount available to fund the 
performance measures, A sample of the results of this process for 
1979-80 are displayed below. 
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After publishing the results of the performance measures, the 
Commission staff recommended appropriations of $2 million out of a 
possible $4 million statewide, but the points awarded under the 
Schedule ranged from 0 to a high of 67. Later, the staff asked 
the institutions to suggest improvements. Some criticisms were 
procedural: not enough consultation or too hurried a time for 
determining budgets. Some criticism involved the measures them- 
selves: th« need for more appropriate ' indicators for two-year 
colleges and graduate institutions. Some criticisms were substan- 
tive: the financial investment needed for the evaluation activities 
was far greater than the dollar return on the Instructional ^valua- 
tion Schedule- Blmtly, some suggested that the entire endeavor 
ironically drained resources "to evaluate quality when existing 
fundingj^Jevels were not sufficient to produce quality "in the first 
place." 

Until 1982, the Commission changed the system little, preferring to 
gain experience over several years before rearranging things dras- 
tically. Then, in August 1982, the Commission's staff proposed 
different variables for the Instructional Evaluation Schedule for 
the Fall 1983. These new variables "are in the direction of greater 
objectivity, increased emphasis on the quality of the evaluation 
product rather than the evaluation process, and greate^ flexibility 
of application to the different types of institutions." 

Specifically, the new variables emphasize objective tests and 
placement of graduates and lessen the importance of evaluation by 
students, alumni, employers, or educational peers. The following 
table highlights these changes: 
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The Tennessee Experiment: A Critique 

The fonral features of Tennessee's experiment with performance 
funding are extremely sound. The Tennessee Commission developed 
its projects through a long and patient process which actively 
involved state officials, state educational staff, institutional 
administrators , faculty, independent advisory boards, and profes- 
sional evaluators. This -^Partnership Model" is crucial for the 
success of any enterprise which reaches directly into the education- 
al process. The use of documents to focus planning and spark 
debate was a wise choice. Tne actual performance measures showed 
admirable variety and reflected a concern with the individual 
missions and circumstances of the campuses. Performance funding 
can serve to further stratify a state's institution by insuring 
that "the rich get richer and the poor get poorer," and Tennessee 
tried hard, to avoic" this. In addition, funds provided under th? 
Instructional Evaluation Schedule are additions to. each institu- 
ti-n's budget, not amounts taken from them. The significant expense 
of documenting, refining, and applying the performance measures 
suggests that the state should be willing to accept it as a major 
component of the formula, one rewarding enough to justify the extra 
efforts of the institutions. 

Is the Tennessee experiment a success so far? Narrowly, this can 
be answered by reference to the original objectives of the perfor- 
mance measures, as defined by state officials and educators: 

a. to sharpen institutional mission; 

b. to complement the enrollment-based formula; 

c. to design an objective means of measuring educational outcomes; 

d. to measure the educational "value added" by each institution; 

e. to promote instituional excellence without competition. 
The record is mixed for achieving these objectives. 

From all the reports and conferences on this project, it is safe to 
conclude that the process has helped sharpen institutional mission 
by focusing attention on educational processes, it has complemented 
the general formula, and it is the most prominent effort nationally 
to measure educational outcomes for extra dollars from the State. 
However, none of the performance variables in the 1979 Instructional 
Evaluation Schedule directly measured "value-added" in the sense of 
the improvement of individuals over time within the educational 
system Also, competition among institutions is certainly fostered 
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by those variables which added points if an institution's graduates 
or programs outranked the performance at other institutions, even 
when the competition is only among institutions with similar mis- 
sions. Overall, however, the results of the Tennessee experiment 
should be considered a qualified success in reaching its objectives, 
especially considering the obstacles. 

But two larger questions come to mind: Is performance funding 
going to replace existing formulas throughout the nation ? Probably 
not. The success of performance funding rests squarely on a state's 
objectives. If the state intends to increase faculty productivity 
or to improve the instruction directly through performance funding, 
its efforts will likely fail. For these objectives, the Tennessee 
experience shows that performance funding would be an expensive 
and — at best—an indirect means. 

Shouldn ' t s ystematic evaluation of the sort rewarded in Teojiessee 
occur already in institutions of higher education ? Ideally so, but 
most state formulas do not provide resources for such efforts and 
the institutions would be hard pressed to divert resources on any 
large scale. Presumably, the formulas could add funds for evalua- 
tions which might parallel the efforts in Tennessee which is, with 
all the jargon removed, really a categorical program for promoting 
evaluation, surely an important state policy. 

From my perspective, performance funding as implemented in Tennessee 
is not a panacea which directly links dollars to educational 
achievements. Rather, it is best understood as a way to institu- 
tionalize introspection through the state budget. 
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